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REMARKS 

By this amendment the Applicants respectfully delete claims 1-13 and add 14-32, 
therefore on entering this amendment claims 14-32 are all the claims pending in the present 
Application. 

The Applicants attach a revised specification, rendering the objections to the specification 
moot. The Applicants assert that no new matter has been added. The Applicants also attach a 
red-lined version of the specification showing deletions and additions. Since the new 
specification contains a revised Abstract obviating the Examiner's objections to the Abstract, a 
separate Abstract has not been included. 

The prior art rejections of the pre-existing claims are moot since they have been cancelled 
and new claims presented for Examination. However, the Applicants request the Examiner to 
consider the following general remarks distinguishing the present invention (as recited in the 
newly presented claims) from the cited references Ogawa and Stern. 

The technique described in Ogawa can not detect the distance in real time because several 
images (possibly 4 to 5 images) are required therein to detect the distance. In the present 
invention, detecting the distance can be processed in real time because the distance is detected 
from only two images. 

In Fig. 2 of Ogawa, and in accompanying passages, the distance can only be detected in 
discrete values. Using the present invention, the distance can be detected sequentially. For a 
non-limiting example, see Equation (13). Likewise, the gate passing light in Ogawa is formed in 
pulse train so that only the light emitting device which has the capability of high speed 
modulation such as laser emitting device can be used for the light source. On the other hand, in 
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the present invention, the changing rate of the illumination light is slower than the changing rate 
of the image pick-up gain. Therefore, light emitting device which has slower modulation speed 
such as light emitting diode (LED) can be used for the light source. These devices are safer and 
more like natural light, so that the detecting device becomes more suitable for practical use. 

Further, to use the techniques of Ogawa, as described in Fig. 8 of Ogawa, a plurality of 
costly Image Intensifiers are required, making it impractical for common usage. Moreover, 
packaging a plurality of Image Intensifiers in a compact fashion is exceedingly difficult because 
the Image Intensifier uses high voltage power that requires larger terminals. The present 
invention can obtain the series of images of the object using only one Image Intensifier. 
Therefore, the present invention can reduce the cost and the size of the system. 

Still further, referring to Fig. 2 of Ogawa, the gate of Image Intensifier needs to be 
opened for a certain amount of time even though the reflected light from the object is not 
acquired. (For instance the light acquisition is performed only once even though the image pick- 
up gain is opened 5 times). Therefore, the image obtained by the Image Intensifier is more 
sensitive to the background (environmental) light. On the other hand, in the present invention, 
the changing rate of the pick-up gain is set faster than the changing rate of the intensity of the 
illumination light. Hence, the image obtained becomes less sensitive to the background light. 

Still further, referring to Fig. 9 of Ogawa, both the illumination light and the image pick- 
up gain are modulated in sinusoidal pattern. This could prevent the effective use of the dynamic 
range of the Image Intensifier. In this case, the acquired image would become darkest when the 
illumination light and the image pick-up gain are in opposite phase, but it will not become totally 
black (i.e. image level 0%). Therefore, this method is not capable of being used across the 
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whole dynamic range (image level 0% to 100%) of the Image Intensifier. On the other hand, the 
changing rate of the intensity level of the illumination is slower than the changing rate of the 
image pick-up gain. Hence, the image acquired includes the intensity level from 0% to 100% by 
using the dynamic range of the CCD most efficiently. 

Clearly, the technique described in Ogawa uses a pulse light to illuminate, and detects the 
reflected light from the object only 'once' (see Fig. 2, Gate passing light A, B). Therefore, its 
detected signal level is very low. The low level of the detected signal, and the amount of the 
shot noise that occurs in the image intensifier prevents improving the signal/noise ratio of the 
signal used for detecting distance. 

In the present invention, the illumination of the object and the detection of the reflected 
light from the object by the image intensifier is repeated a number of times within a period of 
time corresponding to a single frame of the video signal, and the image is obtained by an image 
pick-up element having storage effect. Therefore, the signal/noise ratio of the distance detecting 
signal is improved drastically. 

When the set of the illumination and the detection has been done for M times and the 

detected signal stored by a CCD, the signal/noise ratio improves proportional to the value 4m . 
The value of M ranges around 166000 to 830000 when the signals are stored in CCD at a 
frequency of lOMKz to 50MHz within a single image field (1/60 second). Therefore, the 
signal/noise ratio is improved drastically, reducing the effect from the shot noise occurring in the 
image intensifier. And by improving the signal/noise ratio, the resolution of distance detection is 
improved and the power of the illumination light can be decreased. Therefore, the distance 
detection of the present invention can be applied to obtain an image of the human figure. 
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Furthermore, the signal/noise ratio can be improved even when using a high resolution detecting 
device that has small detecting area for each pixel. In such a case, the distance detection 
technique of the present invention can be applied for a high definition image such as a HDTV. 

In Stern, it is disclosed that the pulse duration might be 50-5000 psec (col. 7, line 65). In 
this case, the light intensity obtained in a single shot would be so low that even by amplifying it 
corresponding to the image pick-up gain, one can not improve the S/N ratio. And if the output 
power is increased to overcome this problem, the system becomes unusable for imaging live and 
moving objects. Further, the required environment and condition for using the system will be 
limited. On the other hand, in the present invention, the image is obtained a plurality of times by 
an image pick-up element having storage effect. For example, in a non-limiting way, a two- 
dimensional CCD can be used as the image pick-up element when the modulation cycle of die 
illumination light is set to 45 MHz. Approximately 750000 times of image can be obtained 
within a single frame of a video signal (a single frame corresponds to 1/60 second) with high SN 
ratio and enough sensibility. Moreover, the output power needed to obtain an image is low 
enough to use the system for imaging live and moving objects. 

Further, Stern does not disclose detecting the distance in real time. There also is no 
disclosure about the timing of the real time detection or about which information is to be 
obtained. The method described in Figs. 5-9 of Stern has the advantage of broadening the 
detecting range. However, switching is required, so that many image are required to calculate 
the distance, making it impractical to perform real time processing. 

The present invention, on the other hand can be applied to a TV camera. As an example 
of a specific application of some of the dependant claims, images are obtained a plurality of 
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times with the first image pick-up gain increasing with time, and the second image pick-up gain 
decreasing with time. And by using these two images and equation (26), the two-dimensional 
image having distance information whose unit corresponds to the pixels of CCD can be obtained. 
The present invention is capable of calculating the distance at a speed within a period of time 
corresponding to a frame of a video signal because it detects the distance sequentially on the 
basis of the two images. 

Further, the present invention can broaden the detecting range by enlarging the value of X 
(the modulation wavelength of image pick-up gain) in equation (26). 

Still further, it is believed that the below listed equations are described in Stern et al. 
(U.S. Patent 5,216,259) are inconsistent and, as they read at present, would not constitute a 
relevant and useful teaching of the subject matter that the Examiner alleges Stern to be teaching. 

(S 1)T ) 

Equation 1) t T = g } - 1 in col. 5, line 65 of Stern 

($2,t) 
t-t 0 

Equation2) g } (t) = in col. 6, line 1 of Stern 

t 2 - 1 0 

Equation3) gf 2 (x) = t 0 + x(t 2 - 1 0 ) in col. 6, line 10 of Stern 

It appears that the Equation 1 is erroneous and is believed to be a misprint of 

// s it\ 
t T = gj — (Equation 1 ') 

\ s 2,r/ . The correct equation is referred to hereinafter as Equation 1'. Only in 

t T = h + (h ' 

such a case Equation 1' will be consistent with Equation3. This is because 
However, it is unclear that whether the function gf^x) in the Equationl, 3 and the function gj(t) 
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in the Equation2 are equal or not. If those are equal, Equation2 and the Equation3 are not 
consistent. If those are different functions dependent on each other, the description of the 
Equations 1, 2 and 3 in Stern would not make any sense. Therefore, the technique described in 
Stern is indefinite and unclear. 

In present invention, the distance "d" is clearly derived from Equation (17) or (18). 

CONCLUSION 

In view of the above, reconsideration and allowance of this application are now believed 
to be in order, and such actions are hereby solicited. If any points remain in issue which the 
Examiner feels may be best resolved through a personal or telephone interview, the Examiner is 
kindly requested to contact the undersigned at the telephone number listed below. 

The USPTO is directed and authorized to charge all required fees, except for the Issue 
Fee and the Publication Fee, to Deposit Account No. 19-4880. Please also credit any 
overpayments to said Deposit Account. 

Respectfully submitted, 

SUGHRUE MION, PLLC Chidambaram Subramanian 

Telephone: (202) 293-7060 Registration No. 43,355 

Facsimile: (202) 293-7860 



WASHINGTON OFFICE 




23373 

PATENT TRADEMARK OFFICE 

Date: January 21, 2003 
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APPENDIX 

VERSION WITH MARKINGS TO SHOW CHANGES MADE 

IN THE SPECIFICATION : 

Please REPLACE the specification as originally filed with the SUBSTITUTE 

specification attached herewith. 

IN THE CLAIMS : 

Please CANCEL claims 1-13 without prejudice or disclaimer. 

Please ADD the following claims: 

14. (NEW) A method of detecting three-dimensional information, comprising: 

illuminating an object sequentially with at least two illumination lights, at least one of the 
first or second of the two illumination lights with an intensity that varies with time; 

acquiring an image of the object illuminated by said at least two illumination lights by 
acquisition of a image pick-up gain having faster changing rate than a changing rate of the 
intensity of the illumination lights, wherein the image of the object is acquired a plurality of 
times by an image pick-up element having storage effect; and 

detecting a distance between individual points of the object on the basis of the image 
obtained; wherein 

the distance between respective points of the object is detected at a speed at which three- 
dimensional information is followed real time within a period of time corresponding to a frame 
of a video signal. 
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15. (NEW) A method of detecting three-dimensional information, comprising: 
illuminating an object sequentially with at least two illumination lights, at least one of the 

first or second of the two illumination lights with an intensity that varies with time; 

acquiring an image of the object illuminated by said at least two illumination light by 
acquisition of the given level of a image pick-up gain with shorter changing cycle than a 
changing cycle of the intensity of the illumination light, wherein the image of the object is 
acquired a plurality of times by an image pick-up element having storage effect; and 

detecting a distance between individual points of the object on the basis of the image 
obtained; wherein 

the distance between respective points of the object is detected at a speed at which three- 
dimensional information is followed real time within a period of time corresponding to a frame 
of a video signal. 

16. (NEW) A method of detecting three-dimensional information, comprising: 
illuminating an object with an illumination light; 

acquiring an image of the object illuminated by the illumination light by acquisition of at 
least two image pick-up gain, at least one of said image pick-up gain changing with time, and the 
image pick-up gain having slower changing rate than a changing rate of the illumination light, 
wherein the image is acquired a plurality of times by an image pick-up element having storage 
effect; and 

detecting a distance between individual points of the object on the basis of the image 
obtained; wherein 
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the distance between respective points of the object is detected at a speed at which three- 
dimensional information is followed real time within a period of time corresponding to a frame 
of a video signal. 

17. (NEW) A method of detecting three-dimensional information, comprising: 
illuminating an object with an illumination light; 

acquiring an image of the object illuminated by the illumination light by acquisition of at 
least two image pick-up gain, at least one of said image pick-up gain changing with time, and the 
image pick-up gain having slower changing cycle than a illuminating time of the illumination 
light with given level of intensity, wherein the image of the object is acquired a plurality of times 
by an image pick-up element having storage effect; and 

detecting a distance between individual points of the object on the basis of the image 
obtained; wherein 

the distance between respective points of the object is detected at a speed at which three- 
dimensional information is followed real time within a period of time corresponding to a frame 
of a video signal. 

18. (NEW) The method of detecting three-dimensional information as defined in 
claim 14, wherein 

a first and a second optical images of the object illuminated by the first and the second 
illumination light are formed; 
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the first and the second optical images are obtained alternately by acquiring the first and 
the second optical images with a single image pick-up gain over a given period of time; 
the first and the second images obtained are stored; and 

the distance between respective points of the objects are detected by each of the first and 
second images and are detected sequentially for each frame of the video signal. 

19. (NEW) The method of detecting three-dimensional information as defined in 
claim 15, wherein 

a first and a second optical images of the object illuminated by the first and the second 
illumination light are formed; 

the first and the second optical images are obtained alternately by acquiring the first and 
the second optical images with a single image pick-up gain over a given period of time; 

the first and the second images obtained are stored; and 

the distance between respective points of the objects are detected by each of the first and 
second images and are detected sequentially for each frame of the video signal. 

20. (NEW) The method of detecting three-dimensional information as defined in 
claim 14, wherein the intensity of the first illumination light is increased or decreased with time, 
and the second illumination light has a given intensity. 



19 



Serial No. 09/418,441 Docket No. Q56262 

21. (NEW) The method of detecting three-dimensional information as defined in 
claim 14, wherein the intensity of the first illumination light is increased with time, and the 
second illumination light is decreased with time. 

22. (NEW) The method of detecting three-dimensional information as defined in 
claim 15, wherein the intensity of the first illumination light is increased or decreased with time, 
and the second illumination light has a given intensity. 

23. (NEW) The method of detecting three-dimensional information as defined in 
claim 14, wherein the intensity of the first illumination light is increased with time, and the 
second illumination light is decreased with time. 

24. (NEW) The method of detecting three-dimensional information as defined in 
claim 16, wherein 

first and second optical images of the object illuminated by first and second illumination 
light which illuminate with single intensity over a predetermined period of time, are formed; 

first and second images are obtained alternately by acquiring the first and second optical 
images with first and second image pick-up gains, the first and second images obtained are 
stored; and 

the distance between respective points of the object is detected from the first and second 
images which are detected sequentially for each frame of the video signal. 

20 
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25. (NEW) The method of detecting three-dimensional information as defined in 
claim 17, wherein 

first and second optical images of the object illuminated by first and second illumination 
light which illuminate with single intensity over a predetermined period of time, are formed; 

first and second images are obtained alternately by acquiring the first and second optical 
images with first and second image pick-up gains, the first and second images obtained are 
stored; and 

the distance between respective points of the object is detected from the first and second 
images which are detected sequentially for each frame of the video signal. 

26. (NEW) The method of detecting three-dimensional information as defined in 
claim 16, wherein the first image pick-up gain changes with time, and the second image pick-up 
gain is uniform. 

27. (NEW) The method of detecting three-dimensional information as defined in 
claim 16, wherein the first image pick-up gain is increased with time, and the second image pick- 
up gain is decreased with time. 

28. (NEW) The method of detecting three-dimensional information as defined in 
claim 17, wherein the first image pick-up gain changes with time, and the second image pick-up 
gain is uniform. 

21 



Serial No. 09/418,441 Docket No. Q56262 

29. (NEW) The method of detecting three-dimensional information as defined in 
claim 17, wherein the first image pick-up gain is increased with time, and the second image pick- 
up gain is decreased with time. 



30. (NEW) A device for detecting three-dimensional information pertaining to an 
object comprising: 

a projection section projecting illumination light having given intensity on the object; 
an image pick-up section acquiring an image of the object with a given image pick-up 

gain; 

a storage section temporary storing the image acquired by the image pick-up section; and 
a signal processing section which calculates a distance between respective points of the 

object on the basis of intensity level information included in a video signal output from the 

image pick-up section, 

wherein the distance between respective points of the object is detected at a speed at 

which the three-dimensional information are followed real time within a period of time 

corresponding to the frame of a video signal. 

31. (NEW) The device for detecting three-dimensional information as defined in 
claim 30, wherein the projection section comprises: 

a law diode or a light-emitting diode whose light is modulated in accordance with an 
electric signal, and 
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a modulator capable of modulating light emitted from the laser diode or the light-emitting 

diode. 

32. (NEW) The device for detecting three-dimensional information as defined in 
claim 30, wherein the image pick-up section comprises: 

imaging means for producing an optical image upon receipt of light reflected from the 

object; 

an image pick-up element which captures the optical image and outputs a video signal; 

and 

an image intensifier with gating operation which is disposed between the imaging means 
and the image pick-up element and which controls an image pick-up gain. 
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[WHAT IS CLAIMED IS:] 



METHOD AND DEVICE FOR DETECTING THREE-DIMENSIONAL 

INFORMATION 

DETAILED DESCRIPTION OF THE INVENTION 

Field of the Invention 

[01] The present invention relates to a method and apparatus for detecting 
three-dimensional information pertaining to an object which can be 
applied to acquisition of a three-dimensional image, and more 
particularly, to a method and device which detects three-dimensional 
information pertaining to an object by two-dimensionally measuring the 
distance between points of the object at a speed at which the three- 
dimensional information can be followed in real time within a period 
relating to a frame of a video signal (hereinafter referred to simply as a 
"frame period")* 



Prior Art 
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[02] The following methods have conventionally been employed as techniques 
for measuring the distance between an object and an image acquisition 
device or three-dimensional information through use of light. 

[03] (1) As shown in FIG. 12, a pulse laser beam or a laser beam whose 
amplitude is modulated by a sinusoidal wave is radiated onto an object, 
and the distance between the object and the laser is measured on the basis 
of a period of time during which reflected light returns to the laser or a 
modulated phase of the reflected light. 

[04] (2) As shown in FIG. 13, under the method (1), the distance between the 
respective points of an object is two-dimensionally measured by two- 
dimensionally scanning the laser beam over the object. 

[05] (3) As shown in FIG. 14, illumination light is modulated by a sinusoidal 
signal, and a light amplification gain of an image intensifier disposed in 
front of an image pick-up element is modulated through use of the 
sinusoidal signal. An optical image formed by collecting light reflected 
from the object through use of a lens includes a modulated phase 
corresponding to the distance between the object and the lens. Of an 
optical image input to the image intensifier, only a portion of the image 
whose phase matches a change in the light amplification gain is 
emphasized. As a result, the points of the object equidistantly spaced 
away from the lens can be two-dimensionally captured in the form of 
contour lines. The principle behind the third method is described in 
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detail in Japanese Patent Application Laid-Open No. Hei-6-294868 
entitled "Imaging Laser Radar Device," 

Problem to be Solved by the Invention 

[06] According to the method described in connection with (1), the distance 
between a single point of the object and the laser is measured, and hence 
three-dimensional information pertaining to the object cannot be 
produced. In order to acquire three-dimensional information by 
measuring two-dimensional distribution of the distance among the 
respective points of the object, the light beam must be moved so as to two- 
dimensionally scan the object as mentioned in the method (2). 
Alternatively, according to method (3), since only portions of the object 
equidistantly spaced away from the lens are extracted, the modulated 
phase of illumination light must be changed to only a required extent in 
order to acquire three-dimensional information pertaining to the entirety 
of the object. Methods (2) and (3) require two-dimensional raster- 
scanning of an illumination light beam and a change in the modulated 
phase of the illumination light. Therefore, under these methods, 
acquiring three-dimensional information pertaining to the object at a 
speed equal to the frame period of a video signal is difficult. Therefore, 
the methods are not suitable for acquiring a three-dimensional image. 

[07] The object of the present invention is to provide a method and device 
which solve the problem of the conventional technique, are suitable for 
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acquiring a three-dimensional image, and enable detection of three- 
dimensional information pertaining to an object within a period of time 
corresponding to the frame of a video signal. 
Means for Solving the Problem 

[08] A three-dimensional information detecting method of the present 
invention comprises steps of: forming an image of an object illuminated 
by illumination of the modulated light having given intensity as an optical 
image, and detecting the distance between individual points of the object 
on the basis of an image obtained by acquisition of the optical image with 
a given image pick-up gain. Under this method, either the given intensity 
or the image pick-up gain is changed with time, and the distance between 
respective points of the object can be detected at a speed at which the 
three-dimensional information can be followed real time within a period 
of time corresponding to the frame of a video signal. By utilization of the 
intensity or image pick-up gain which is changed with time, the two- 
dimensional distribution of intensity of light including information 
pertaining to the distance between the respective points of the object is 
acquired. Accordingly, the distance between respective points of the 
object can be determined on the basis of the intensity level information, 
whereby three-dimensional information pertaining to the object can be 
detected. 
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[09] The image of the object can be acquired a plurality of times within the 
period of time corresponding to one frame of the video signal. In such a 
case, a signal-to-noise ratio (S/N) is improved by means of the storage 
effect of the image pick-up element, and the image pick-up intensity is 
enhanced. 

[10] A device for detecting three-dimensional information of the present 
invention comprises a projection section capable of projecting 
illumination light having given intensity on an object; an image pick-up 
section capable of acquiring an image of the object with a given image 
pick-up gain; and a signal processing section which calculates the distance 
between respective points of the object on the basis of intensity level 
information included in a video signal output from the image pick-up 
section. Either the given intensity or the image pick-up gain is changed 
with time, and the distance between respective points of the object can be 
detected at a speed at which the three-dimensional information can be 
followed real time within a period of time corresponding to the frame of a 
video signal. By utilization of the intensity or image pick-up gain which is 
changed with time, the two-dimensional distribution of intensity of the 
image of the object that is acquired by the image pick-up section includes 
information pertaining to the distance between the respective points of the 
object. Accordingly, the signal processing section can calculate the 
distance between respective points of the object on the basis of the 
intensity level information. The device can acquire an image of the object 
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within a sufficiently short period of time. So long as the signal processing 
section can compute the distance between respective points of the object 
at sufficient speed, the distance between respective points of the object 
can be detected at a speed at which the three-dimensional information can 
be followed within a period of time corresponding to the frame of a video 
signal. 

Embodiments of the Invention 

Various embodiments of the present invention will be described 
hereinbelow by reference to the accompanying drawings. FIG. 1 is a 
schematic diagram showing a three-dimensional information detecting 
device according to a first embodiment of the present invention. The 
device comprises a projection section 10 capable of illuminating an object 
with illumination light S6 whose amplitude is modulated; an image pick- 
up section 11 which receives light S7 reflected from the object while 
changing an image pick-up gain with time and captures an optical image 
of the object; a signal processing section 7 for converting video signals 
S41 and S42 output from the image pick-up section 11 into a three- 
dimensional information signal S5; and a signal generation section 1 
which produces an illumination light modulation signal SI, an image 
pick-up modulation signal S2, and a control signal S3. The specific 
configuration of these constituent elements will be described later. 



[12] The principle behind the three-dimensional information detecting method 
of the present invention which uses the device shown in FIG. 1 will be 
described by reference to a specific example in which the intensity of the 
light source or an image pick-up gain is linearly changed with time. 

[13] The three-dimensional information detecting method according to a first 
embodiment of the present invention will be described by reference to 
FIGS. 2 and 3. As shown in FIG. 2A, the intensity I of illumination light 
is subjected to amplitude modulation, to thereby obtain I=St, where "t" 
represents time and "S" represents the rate of increase in intensity (= 
2Io/T). As shown in FIG. 2B, the intensity I R of light reflected from the 
object which is spaced by only distance "d" away from an exit of the 
projection section 10 is changed, as specified by S(t-2d/v), with a delay 
equal to a duration of time during which light travels between the 
projection section and the object (=2d/v, where "v" represents light 
speed). If reflected light having intensity 1+ at certain time t=t 0 is 
acquired for only a short period of time At («T) while an image pick-up 
gain "g" is taken as g=go (>0), the intensity 1+ of the resultant image is 
expressed by Equation (1). 

7 **° = fA °,2* 8oS(t 0 -2d/v) ...(1) 

where a represents the area of the backward scattering cross-section of 
an object. Equation (1) includes information pertaining to the distance 
between the object and the three-dimensional information detecting 
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device. In order to eliminate the dependency of term a I {And 2 ) 2 , the 
second image of the object is acquired while the intensity I of illumination 
light is uniformly maintained at I=I r for a short period of time At from 
time T\ At this time, luminous intensity I re fgo is expressed by Equation 
(2). 



7 ^ = (^^ - (2) 



The following equation is derived from Equations (1) and (2). 



^ = i^ = ^o- 2d/ »>.„(3) 
From Equation (3), we have 



d = —V 
2 



f I ^ 



v S j 
Further, let I r =Io; then 



...(4). 



1 ( T 



d =-v\ t n 



..(5). 



2 V 2 \ 

From Equation (4) or (5), we have distance "d." 

[14] As mentioned above, the intensity of respective points of an optical image 
formed by collection of the light reflected from the object exposed to 
amplitude-modulated light includes information pertaining to the 
distance between the three-dimensional information detecting device and 



a corresponding point of the object. So long as the object is captured in 
the manner as mentioned above and Equation (4) or (5) is applied to the 
intensity of each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
obtained, whereby three-dimensional information pertaining to the object 
can be detected. 

As shown in FIGS. 3 A and 3B, even when the intensity I of the light 
source diminishes, as specified by I=I 0 -St, the distance "d" can be 
obtained in the same manner as mentioned previously. 



I-8o = 



2\2 



{And') 



g 0 {l 0 -S(t 0 -2d/v)} ...(6) 



R ! - 8 ° h-S'it 0 -2dlv) (?) 

I ref So Ir 



d = — V 

2 



.(8) 



Further, let I r =Io; then 



d=±vL~(l-R_)\ ...(9). 



As in the case of the previous example, the optical image formed by 
collection of light reflected from the object. So long as Equation (8) or (9) 
is applied to each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
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obtained, whereby three-dimensional information pertaining to the object 
can be obtained. 

Referring to FIG. 4, a three-dimensional information detecting method 
according to a second embodiment of the present invention will now be 
described. As shown in FIG. 4, the object is illuminated while the 
intensity of illumination light is modulated by employment of a triangular 
waveform. An optical image of reflected light is acquired twice; in other 
words, an optical image of reflected light whose intensity is 1+ is acquired 
at time t=to for only a short period of time At («T) with an image pick-up 
gain g=go(>0), and an optical image of reflected light whose intensity is I. 
is acquired at time t=to+T/2 for only a short period of time At («T) with 
the image pick-up gain g=go(>0). From Equations (1) and (6), we have 



Let the wavelength of illumination light modulated by a triangular 
waveform be defined as X=vT; then from S=Io/(T72), we have 



R 



I + g Q S(t 0 -2d/v) 



...(10) 



Lgo I 0 S(t 0 -2d/v) 





X( R 



...(12). 
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Further, if to is set to a given value, distance "d" can be expressed as a 
relative distance with reference to a reference point d re f. Equation (13) 
represents a relative distance with reference to d re f=0 when to=T/4. 



As in the case of the first embodiment, the optical image is formed by 
collection of light reflected from the object. So long as any one of 
Equations (11), (12), and (13) is applied to each of the pixels of the image, 
information pertaining to the distance between the respective points of the 
object are two-dimensionally obtained, whereby three-dimensional 
information pertaining to the object can be obtained. 

According to a method which is complementary to the three-dimensional 
information detecting methods described in connection with the first and 
second embodiments, three-dimensional information pertaining to an 
object can be detected by capturing the image of the object with an image 
pick-up gain, which linearly increases or decreases, through use of 
illumination light modulated in the form of a pulse for a short period of 
time. 

A three-dimensional information detecting method according to a third 
embodiment of the present invention will be described by reference to 
FIGS. 5 and 6. As shown in FIG. 5A, illumination light is modulated such 
that an image pick-up gain "g" is linearly increased (i.e., g=Ut). Further, 
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an object is exposed to light which illuminates like a pulse with intensity 
I=I 0 for only a short period of time At («T). Here, U designates the rate of 
increase in image pick-up sensitivity (=2go/T). The image pick-up gain g+ 
obtained when the light reflected from the object that is spaced only 
distance "d" from the three-dimensional information detecting device has 
returned to the image pick-up device becomes g+=U(t 0 +2d/v). The 
intensity I r og+ of an image resulting from the reflected light being 
captured is expressed by Equation (14). 



Further, in order to eliminate the dependency of term cr/{And 2 ) 2 , the 
object is illuminated for a short period of time At from time T' while the 
image pick-up gain "g" is uniformly maintained at g=g r . At this time, 
luminous intensity Irog r is expressed by Equation (15). 



(7 



I 0 U{t 0 + 2d/v) ...(14) 



{And 2 ) 2 



Lo8r = 



a 



TZlhSr ...(15) 



{And 2 ) 



The following equation is derived from Equations (14) and (15). 



IroSr 



U{t 0 +2dlv) 



...(16) 



From Equation (16), we have 
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Further, suppose g r =go; the following expression is derived from 
U= g0 /(T/2). 



d = —v\ -r 0 +— R. 
2 P 2 + 



...(18) 



The distance "d" is derived from Equation (17) or (18). As in the case of 
the first and second embodiments, an optical image formed by collection 
of the light reflected from the object is captured. So long as Equation (17) 
or (18) is applied to the intensity of each of the pixels of the image, 
information pertaining to the distance between the respective points of the 
object are two-dimensionally obtained, whereby three-dimensional 
information pertaining to the object can be detected. 

[19] As shown in FIG.6A, even when the image pick-up gain "g" decreases 
(g-go-Ut), the distance "d" can be obtained in the same manner as that 
employed previously. 

7 ~*- =7Ar^ I o{so-u{to + 2div)} ...(19) 

{A71jd ) 

2 



-t 0 + °° v -° r 1 ...(21) 



Further, let g r =go? then 
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d ^\ V \ h+ \ "' (22) 



As mentioned previously, an optical image formed by collection of the 
light reflected from the object is captured. So long as Equation (21) or 
(22) is applied to the intensity of each of the pixels of the image, 
information pertaining to the distance between the respective points of the 
object are two-dimensionally obtained, whereby three-dimensional 
information pertaining to the object can be detected. 

A three-dimensional information detecting method according to a fourth 
embodiment of the present invention will now be described by reference 
to FIGS. 7A and 7B. As shown in FIG. 7A, the image pick-up gain "g" is 
modulated through use of a triangular waveform, and an object is 
illuminated twice; in other words, an optical image is illuminated at time 
t=to through use of light which illuminates in a pulsating manner with 
intensity I=I 0 for only a period of time At («T), and an object is 
illuminated at time t=to+T/2 through use of light which illuminates in a 
pulsating manner with intensity I=Io for only a period of time At («T). 
From Equations (15) and (19), we have 



R = 



I rog+ U(f 0 +2dlv) 



...(23) 



IroS- g 0 -U(t 0 +2d/v) 




15 




• 



Suppose the wavelength of the triangular waveform used for modulating 
the image pick-up sensitivity is defined as A,=vT for convenience's sake, 
the following expression is derived from U=go/(T/2). 

d = — vt a ...(25) 

As in the case of the second embodiment, if to is set to a given value, the 
distance "d" can be expressed as a relative distance with reference to the 
reference point d re f. Equation (26) represents the relative distance with 
reference to d re f=0 when to=T/4. 



As mentioned previously, an optical image formed by collection of the 
light reflected from the object is captured. So long as Equation (24), (25), 
or (26) is applied to each of the pixels of the image, information 
pertaining to the distance between the three-dimensional information 
detecting device and the respective points of the object are two- 
dimensionally obtained, whereby three-dimensional information 
pertaining to the object can be detected. 

[21] A method of increasing the image pick-up sensitivity in each of the 
previous embodiments will now be described. In the previously 
embodiments, acquisition of an image having intensity I+go and an image 
having intensity I re fgo for the purpose of determining R+, acquisition of an 



= - 



...(26) 



8U + *y 



image having intensity Lg. and an image having intensity I re fgo for the 
purpose of obtaining R_, or acquisition of an image having intensity I+go 
and an image having intensity Lgo for the purpose of determining R is 
performed a plurality of times within the period of time corresponding to 
one frame of an image signal. As a result, the signal-to-noise ratio (S/N) is 
improved by the storage effect of the image pick-up element used for 
acquiring an image, whereby the image pick-up sensitivity is improved. 
[22] The configuration of the three-dimensional information detecting device 
shown in FIG. 1 will now be described in detail by reference to the 
drawings. 

[23] FIG. 8 shows a projection section 10a which is another embodiment of the 
projection section 10 shown in FIG. 1. The projection section 10a 
comprises a light-emitting element 31 whose light can be directly 
modulated by an illumination modulation signal SI, and an illumination 
optical system 30 which is disposed opposite the light exit surface of the 
light-emitting element 31, which shapes the light emitted from the light- 
emitting element 31, and which directs the light toward the object. For 
example, a semiconductor laser diode or a semiconductor light-emitting 
diode can be employed as the light-emitting element 31. When such a 
light-emitting element is activated directly by the illumination light 
modulation signal SI which is an electric signal, the element can emanate 
light whose intensity is changed at high speed. The thus-produced light is 
shaped by means of an illumination optical system 30 so as to illuminate 
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an object, whereby illumination light S6 is produced. Accordingly, 
illumination light whose intensity is arbitrarily changed at high speed, 
such as increment light, decrement light, or pulse-like light, can be 
realized by means of the illumination light modulation signal SI. As 
mentioned above, the projection section having the configuration shown 
in FIG, 8 can be used as means for controlling the intensity of 
illumination light under the three-dimensional information detecting 
method of the present invention. 

FIG. 9 shows a projection section 10b which is still another embodiment 
of the projection section 10 shown in FIG. 1. The projection section 10b 
comprises a light-emitting element 33 which outputs given light; an 
external modulator 32 which is disposed opposite the light exit surface of 
the light-emitting element 33 and indirectly modulates the light emanated 
from the light-emitting element 33 in accordance with the illumination 
light modulation signal SI; and an illumination optical system 30 which 
shapes the light output from the external modulator 32 and is directed 
toward the object. An electro-optical effect light modulator or an electro- 
acoustic effect modulator can be used as the external modulator 32. Light 
whose intensity is modulated arbitrarily and at high speed can be 
produced by indirect modulation of the given light 34 output from the 
light-emitting element 34, through use of the external modulator 32. The 
thus-produced light is shaped by the illumination optical system 30 so as 
to illuminate an object, whereby the illumination light S6 is produced. 
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Like the projection section shown in FIG. 8, the projection section whose 
configuration is show in FIG. 9 can be used as means for controlling the 
intensity of illumination light under the three-dimensional information 
detecting method of the present invention. - 
[25] FIG. 10 shows an image pick-up section 11 which is another embodiment 
of the image pick-up section 11 shown in FIG. 1. The image pick-up 
section 11 comprises a lens 4 which receives light reflected from an object 
and produces an optical image, an image pick-up element 6 which is 
disposed behind the lens 4 and picks up the optical image output from the 
lens 4, and an image split circuit 22 which outputs a video signal 
pertaining to a plurality of screens included in the electric signal output 
from the image pick-up element 6 while the video signal is divided into 
respective screens. Further, an image intensifier with gating operation 5 
capable of controlling the image pick-up gain in accordance with the 
image pick-up gain modulation signal S2, which is an electric signal, is 
attached to the front surface of the image pick-up element 6 via an optical 
image transfer optical system 20. A fiber plate or lens can be used as the 
optical image transfer optical system 20. Light S7 reflected from an 
object is formed on a photo-electric screen of the image intensifier with 
gating operation 5 by means of the lens 4. An optical image amplified by 
the image intensifier with gating operation 5 is transferred by the optical 
image transfer optical system 20 and input to the photo-electric screen of 
the image pick-up element 6. 
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[26] The light amplification gain of the image intensifier with gating operation 
5 can be controlled at high speed by means of a voltage to be applied to a 
gate 21 of the image intensifier with gating operation 5, In the image 
pick-up section 11, the image pick-up gain can be changed at high speed 
by application of the image pick-up gain modulation signal S2 to the gate 
21. Accordingly, an image pick-up gain which is changed arbitrarily at 
high speed, such as a pulse-like image pick-up gain to be used for 
releasing a shutter for only a short period of time or an increment or 
decrement image pick-up gain, can be achieved. 

[27] In a case where the image pick-up section 11 is used in each of the 
previous embodiments, the image pick-up section 11 must acquire an 
image twice for calculating R+, R., or R and output a video signal 
pertaining to two screens per frame while the signal is split. To this end, 
in the image pick-up section 11, the image pick-up element 6 is activated 
twice as fast as it is activated in normal times, to thereby acquire a video 
signal pertaining to two images. The video signal is output from the 
image split circuit 22 while being divided into a video signal S41 and a 
video signal S42. Alternatively, so long as there is employed an image 
pick-up element capable of acquiring an image for each pixel and at every 
image pick-up operation while effecting switching between the video 
signal S41 and the video signal S42, the video signals 41 and 42 can be 
output while they are split. 
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[28] As mentioned above, the image pick-up section 11 whose configuration is 
shown in FIG. 10 can be used as means for controlling the image pick-up 
gain under the three-dimensional information detecting method of the 
present invention. Further, the image pick-up section 11 can also be used 
as means for outputting two video signals resulting from twice-acquisition 
of an image while being split. 

[29] FIG. 11 shows a signal processing section 7 which is an embodiment of the 
signal processing section 7 shown in FIG. 1. In this signal processing 
section 7, an internal signal is driven at a rate — which is the same as the 
number of pixels of the video signal — and is subjected to pipe- line 
processing in individual circuits. After a synchronous signal has been 
eliminated from the video signals S41 in a synchronous signal separation 
circuit 41, the video signal S43 is stored in an image pick-up level storage 
circuit 1, and the video signal S44 is stored in an image pick-up level 
storage circuit 2. A signal S45 output from the image pick-up level 
storage circuit 1 and a signal S46 output from the image pick-up level 
storage circuit 2 are input to a computation circuit 44, where R+, R_, or R 
and the distance "d" are computed. A signal S47 output from the 
computation circuit 44 is a time-series signal resulting from two- 
dimensional scanning of the distance between the respective sections of 
the object. Time-axis fluctuations in the signal S47 are corrected by a 
storage circuit 45, and a synchronous signal is added to the thus-corrected 
signal b a synchronous signal addition circuit 46. The signal is output as a 
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three-dimensional signal S5 whose video level corresponds to the value of 
information pertaining to the distance "d" between the respective points 
of the object. As mentioned above, the signal processing section 7 whose 
configuration is shown in FIG. 11 can be used as a means for computing 
three-dimensional information pertaining to an object in real time under 
the three-dimensional information detecting method of the present 
invention. 

Advantageous Result of the Invention 

[30] As has been described in detail, the present invention enables two- 
dimensional determination of the distance between individual points of an 
object at a speed at which the three-dimensional information can be 
followed real time within a period of time corresponding to the frame of a 
video signal, as well as detection of three-dimensional information, by 
utilization of information pertaining to the intensity of an image of the 
object acquired under condition that either the intensity of illumination 
light or an image pick-up gain is changed with time. Consequently, the 
method and apparatus of the present invention can be suitably used for 
acquiring a three-dimensional motion picture of an object. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[31] FIG. 1 is a schematic diagram showing the configuration of a three- 
dimensional information detecting device according to a first embodiment 
of the present invention; 
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[32] FIG. 2 is an illustration for describing a method of detecting three- 
dimensional information by utilization of illumination light which linearly 
increases and has given intensity and a pulse-like image pick-up gain in 
combination, wherein FIG. 2A shows a time-varying waveform 
determined by the intensity I of illumination light and an image pick-up 
gain "g," and FIG. 2B shows a time-varying waveform determined by the 
image pick-up gain "g" and the intensity I R of light reflected from an 
object spaced away from a projection section by only distance "d"; 

[33] FIG. 3 is an illustration for describing a method of detecting three- 
dimensional information by utilization of illumination light which linearly 
decreases and has given intensity and a pulse-like image pick-up gain in 
combination, wherein FIG. 3A shows a time-varying waveform 
determined by the intensity I of illumination light and an image pick-up 
gain "g," and FIG. 3B shows a time-varying waveform determined by the 
image pick-up gain "g" and the intensity Ir of light reflected from an 
object spaced away from a projection section by only distance "d"; 

[34] FIG. 4 is an illustration for describing a method of detecting three- 
dimensional information by utilization of illumination light which linearly 
increases and decreases and has given intensity and a pulse-like image 
pick-up gain in combination, wherein FIG. 4A shows a time-varying 
waveform determined by the intensity I of illumination light and an image 
pick-up gain "g," and FIG. 4B shows a time-varying waveform 
determined by the image pick-up gain "g" and the intensity Ir of light 
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reflected from an object spaced away from a projection section by only 
distance "d"; 

[35] FIG. 5 is an illustration for describing a method of detecting three- 
dimensional information by utilization of a given image pick-up gain 
which linearly increases and illumination light having pulse-like intensity 
in combination, wherein FIG. 5A shows a time-varying waveform 
determined by the intensity I of illumination light and an image pick-up 
gain "g," and FIG. 5B shows a time-varying waveform determined by the 
image pick-up gain "g" and the intensity I R of light reflected from an 
object spaced away from a projection section by only distance "d"; 

[36] FIG. 6 is an illustration for describing a method of detecting three- 
dimensional information by utilization of a given image pick-up gain 
which linearly decreases and illumination light having a pulse-like 
intensity in combination, wherein FIG. 6A shows a time-varying 
waveform determined by the intensity I of illumination light and an image 
pick-up gain "g," and FIG. 6B shows a time-varying waveform 
determined by the image pick-up gain "g" and the intensity Ir of light 
reflected from an object spaced away from a projection section by only 
distance "d"; 

[37] FIG. 7 is an illustration for describing a method of detecting three- 
dimensional information by utilization of a given image pick-up gain 
which linearly increases and decreases and illumination light having 
pulse-like intensity in combination, wherein FIG. 7A shows a time- 
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varying waveform determined by the intensity I of illumination light and 
an image pick-up gain "g," and FIG. 7B shows a time-varying waveform 
determined by the image pick-up gain "g" and the intensity I R of light 
reflected from an object spaced away from a projection section by only 
distance "d"; 

[38] FIG. 8 is a schematic diagram showing the configuration of a projection 
section equipped with a light-emitting element whose light is directly 
modulated; 

[39] FIG. 9 is a schematic diagram showing the configuration of a projection 
section equipped with a light-emitting element whose light is indirectly 
modulated; 

[40] FIG. 10 is an illustration showing the configuration of an image pick-up 
section employing an image intensifier (II) with gating operation; 

[41] FIG. 11 is an illustration showing the configuration of a signal processing 
section; 

[42] FIG. 12 is an illustration showing a conventional method of measuring the 
distance between an object and a three-dimensional information detecting 
device on the basis of a lag time or modulated phase of a reflected laser 
beam; 

[43] FIG. 13 is an illustration showing a conventional method of activating a 
laser beam so as to effect two-dimensional scanning; and 

[44] FIG. 14 is an illustration showing the configuration of a conventional 
imaging laser radar apparatus. 
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Description of the Reference Numerals 

1 ... signal generation section, 4 ... lens, 5 ... image intensifier with 
gating operation, 6 ... image pick-up element, 7 ... signal processing 
section, 10 ... projection section, 11 ... image pick-up section, 20 ... 
optical image transfer optical system, 21 ... gate, 22 ... image split circuit, 
30 ... illumination optical system, 31 ... light-emitting element, 32 ... 
external modulator 
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WHAT IS CLAIMED IS : 

1.] A method of detecting three-dimensional information, 
comprising steps of: 

forming an image of an object illuminated by illumination light having 
given intensity as an optical image; and 

detecting a distance between individual points of the object on the 
basis of an image obtained by acquisition of the optical image with a given 
image pick-up gain, wherein either the given intensity or the image pick-up 
gain is changed with time, and the distance between respective points of the 
object can be detected at a speed at which three-dimensional information can 
be followed real time within a period of time corresponding to the frame of a 
video signal. 

[[Claim 2]) 

[2.] The method of detecting three-dimensional information as 
defined in claim 1, wherein first and second optical images of the object 
illuminated by first and second illumination light, either of which includes 
time-varying intensity, are formed; first and second images are obtained by 
acquiring the first and second optical images with a single image pick-up gain 
over a given period of time; and the distance between respective points of the 
object can be detected on the basis of the first and second images at a speed at 
which the three-dimensional information can be followed real time within a 
period of time corresponding to the frame of a video signal. 
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[3.] The method of detecting three-dimensional information as 
defined in claim 2, wherein the intensity of the first illumination light is 
increased or decreased with time, and the second illumination light has a given 
intensity. 

([Claim 1]) 

[4.] The method of detecting three-dimensional information as 
defined in claim 2, wherein the intensity of the first illumination light is 
increased with time, and the second illumination light is decreased with time. 

[[Claim 5]} 

[5.] The method of detecting three-dimensional information as 
defined in claim 1, wherein there are formed first and second optical images of 
the object illuminated by first and second illumination light which illuminate 
with single intensity over a predetermined period of time; and the distance 
between respective points of the object is detected from the first and second 
images which are produced by acquisition of the first and second optical 
images with the first and second image pick-up gains, either of which is 
changed with time, at a speed at which the three-dimensional information can 
be followed real time within a period of time corresponding to the frame of a 
video signal. 

[[Claim 6]] 
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[6.] The method of detecting three-dimensional information as 
defined in claim 5, wherein the first image pick-up gain is increased or 
decreased with time, and the second image pick-up gain is uniform. 

{[Claim 7]) 

[7.] The method of detecting three-dimensional information as 
defined in claim 5, wherein the first image pick-up gain is increased with time, 
and the second image pick-up gain is decreased with time. 

([Claim 8]) 

[8.] The method of detecting three-dimensional information as 
defined in any one of claims 1 through 7, wherein the image is acquired a 
plurality of times within a period of time corresponding to the frame of a video 
signal. 

[[Claim 9]) 

[9.] A device for detecting three-dimensional information 
pertaining to an object comprising: 

a projection section capable of projecting illumination light having 
given intensity on the object; 

an image pick-up section capable of acquiring an image of the object 
with a given image pick-up gain; and 

a signal processing section which calculates the distance between 
respective points of the object on the basis of intensity level information 
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included in a video signal output from the image pick-up section, wherein 
either the given intensity or the image pick-up gain is changed with time, and 
the distance between respective points of the object can be detected at a speed 
at which the three-dimensional information can be followed real time within a 
period of time corresponding to the frame of a video signal. 

([Claim] 

10- H-K.] The device for detecting three-dimensional information 
as defined in claim 9, wherein the projection section is equipped with a light- 
emitting element whose light can be modulated in accordance with an electric 
signal. 

[[Claim] 

1 1- H4M The device for detecting three-dimensional information 
as defined in claim 9, wherein the projection section comprises a light- 
emitting element, and a modulator capable of modulating light emitted from 
the light-emitting element. 

([Claim] 

1244-K-] The device for detecting three-dimensional information 
as defined in claim 9, wherein the image pick-up section comprises: 

imaging means for producing an optical image upon receipt of light 
reflected from the object; 
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an image pick-up element which captures the optical image and 
outputs a video signal; and 

an image intensifier with gating operation which is disposed between 
the imaging means and the image pick-up element and which can control an 
image pick-up gain. 

([Claim] 

13-H-H-] The device for detecting three-dimensional information 
as defined in claim 9, wherein the signal processing section calculates the 
distance between respective points of the object according to the method 
defined in any one of claims 2 through 8. 

[ [DETAILED DESCRIPTION OF THE INVENTION] 

[0001] 

[Field of the Invention] 

The present invention relates to a method and apparatus for detecting 
throo dimensional information pertaining to an object which can be applied to 
acquisition of a three dimensional image, and more particularly, to a method 
and device which detects three dimensional information pertaining to an 
object by two dimensionally measuring th e distance betw e en points of the 
object at a speed at which the thre e dimensional information can be followed 
in real time within a period relating to a frame of a video signal (hereinaft e r 
referred to simply as a "fram e period")- 
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[0002] 
[Prior Art] 

The following methods have conventionally been employed as 
techniques for measuring the distance between an object and an image 
acquisition device or three dimensional information through use of light. 

[0003] 

(1) As shown in FIG. 12, a pulse laser beam or a laser beam whose 
amplitude is modulated by a sinusoidal wave is radiated onto an obj e ct, and 
the distance between the object and the laser is measured on the basis of a 
period of time during which reflected light returns to the laser or a modulated 
phase of the reflected light. 

[0001] 

(2) As shown in FIG. 13, under the method (1), the distance between 
the respective points of an object is two dimensionally measured by two 
dimensionally scanning the laser beam over the object. 

[0005] 

(3) As shown in FIG. 14, illumination light is modulated by a 
sinusoidal signal, and a light amplification gain of an image intensifier 
disposed in front of an image pick up element is modulated through use of th e 
sinusoidal signal. An optical image formed by collecting light reflected from 
the object through use of a lens includes a modulated phas e corresponding to 
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th e distance b e twe e n the obj e ct and tho Ions. Of an optical image input to tho 
imago intonsifier, only a portion of th e image whose phas e matches a change 
in the light amplification gain is emphasized. As a result, the points of the 
object equidistantly spaced away from tho Ions can be two dimensionally 
captured in tho form of contour lines. Th e principl e behind the third method is 
described in detail in Japanese Patent Application Laid Open No. Hei 6 
291868 entitled "Imaging Laser Radar Device." 

[0006] 

[Problem to be Solved by the Invention] 

According to the mothod described in connection with (1), the 
distance between a single point of the obj e ct and the laser is measured, and 
hence three dimensional information pertaining to the object cannot be 
produced. In order to acquire throe dimensional information by measuring 
two dimensional distribution of the distance among the respectiv e points of 
the object, the light beam must be moved so as to two dimensionally scan tho 
object as mentioned in tho mothod (2). Alternatively, according to method (3), 
since only portions of the obj e ct equidistantly spaced away from the lens are 
extracted, th e modulated phase of illumination light must be changed to only a 
required extent in order to acquire three dimensional information pertaining to 
the entir e ty of the object. Methods (2) and (3) require two dimensional raster 
scanning of an illumination light beam and a chang e in tho modulated phase of 
the illumination light. Therefore, under thes e methods, acquiring three 
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dimensional information pertaining to the object at a speed equal to th e fram e 
period of a video signal is difficult. Ther e for e , the methods are not suitable for 
acquiring a three dimensional image. 

[0007] 

The object of the present invention is to provide a method and device 
which solve the problem of the conventional technique, are suitable for 
acquiring — a — three dimensional — image, — and — enable — d e tection — of three 
dimensional information pertaining to an object within a period of time 
corresponding to the frame of a video signal. 

[0008] 

[Means for Solving the Problem] 

A thr e e dimensional information det e cting method of the present 
invention comprises steps of: forming an imag e of an object illuminated by 
illumination of the modulated light having given intensity as an optical image, 
and detecting the distance betw e en individual points of the object on the basis 
of an image obtained by acquisition of the optical image with a given image 
pick up gain. Under this method, either the given intensity or the image pick 
up gain is changed with time, and the distance betw e en respective points of the 
object can be detected at a speed at which th e three dimensional information 
can be followed r e al time within a period of time corresponding to the fram e 
of a video signal. By utilization of th e int e nsity or image pick up gain which is 
changed with time, the two dimensional distribution of intensity of light 
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including information p e rtaining to the distance between the respective points 
of the object is acquired. Accordingly, the distance between respective points 
of the object can be determined on the basis of the intensity level information, 
whereby three dimensional information pertaining to the obj e ct can be 
dotectod. 

[0009] 

The imago of the object can be acquired a plurality of times within 
the period of time corresponding to on e frame of the video signal. In such a 
case, a signal to noise ratio (S/N) is improved by means of the storage effect 
of the image pick up element, and the image pick up intensity is enhanced. 

[0010] 

A device for detecting three dimensional information of the present 
invention comprises a projection section capable of projecting illumination 
light having given intensity on an object; an image pick up section capable of 
acquiring an image of the obj e ct with a given image pick up gain; and a signal 
processing section which calculates the distance between respective points of 
the obj e ct on the basis of intensity l e vel information included in a video signal 
output from the image pick up section. Either the given intensity or the imago 
pick up gain is changed with time, and the distance botw r con respective points 
of the obj e ct can be detect e d at a speed at which the three dimensional 
information can b e followed real tim e within a period of tim e corresponding to 
the frame of a video signal. By utilization of the intensity or image pick up 
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gain which is changed with tim e , the two dimensional distribution of intensity 
of the image of the object that is acquired by th e image pick up section 
includ e s information pertaining to the distance between the respective points 
of the object. Accordingly, th e signal processing section can calculate the 
distance between respective points of the object on the basis of the intensity 
level information. The device can acquire an imag e of the object within a 
sufficiently short period of time. So long as the signal processing section can 
comput e the distance between respective points of the object at sufficient 
speed, the distance b e tween respective points of the object can be detected at a 
speed at which the three dimensional information can be followed within a 
period of time corresponding to the frame of a video signal. 

[0011] 

[Embodiments of the Invention] 

Various embodiments of the present invention will be described 
hereinbelow by reference to the accompanying drawings. FIG. — 1 — k> — a 
schematic diagram showing a three dimensional information detecting device 
according to a first embodiment of the present invention. The device 
comprises a projection section 10 capable of illuminating an object with 
illumination light S6 whos e amplitude is modulated; an imag e pick up section 
11 which receives light S7 reflected from the object while changing an image 
pick up gain with time and captures an optical image of the object; a signal 
processing section 7 for converting video signals S41 and S12 output from the 
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imago pick up section 11 into a three dimensional information signal S5; and 
a signal g e neration section 1 which produces an illumination light modulation 
signal SI, an image pick up modulation signal S2, and a control signal S3. The 
specific configuration of these constitu e nt elements will be described later. 

[0012] 

The principle behind the throe dimensional information detecting 
m e thod of the present invention which uses the device shown in FIG. 1 will be 
described by reference to a specific example in which the intensity of the light 
source or an image pick up gain is linearly changed with time. 

[0013] 

The three dimensional information detecting method according to a 
first embodiment of the present invention will be described by reference to 
FIGS. 2 and 3. As shown in FIG. 2 A, the intensity I of illumination light is 
subjected to amplitude modulation, to thereby obtain I = St, where "t" 
represents time and "S" represents the rate of increase in intensity (= 2I0/T). 
As shown in FIG. 2B, the intensity IR of light reflected from the object which 
is spaced by only distance "d" away from an exit of the projection section 10 
is changed, as specified by S(t 2d/v), with a delay equal to a duration of time 
during which light travels betwe e n the projection section and the object 
( = 2d/v, where "v" represents light speed). If reflected light having intensity I \ 
at certain time t = t0 is acquired for only a short period of time t («T) while an 
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image pick up gain "g" is taken as g = gO (>0), the intensity I n of the resultant 
image is express e d by Equation (1). 

[0011] 
Ml) 

where represents th e area of the backward scattering cross section of 
an object. Equation (1) includes information p e rtaining to the distance 
between the object and the three dimensional information detecting device. In 
order to eliminate the dependency of term , the second image of the object is 
acquired while the intensity I of illumination light is uniformly maintained at 
I = Ir for a short period of time t from tim e T\ At this time, luminous intensity 
IrefgO is expressed by Equation (2). 

[0015] 

The following equation is derived from Equations (1) and (2). 
From Equation (3), we have 
Furth e r, let Ir = I0; then 

From Equation (A) or (5), we have distance "d." 
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[0016] 

As mentioned above, the intensity of respective points of an optical 
imag e formed by collection of th e light reflected from th e object exposed to 
amplitud e modulated light includes information pertaining to the distance 
between — the — three dimensional — information — detecting — devic e — aftd — a 
corresponding point of the object. So long as the object is captured in the 
manner as mentioned above and Equation (4) or (5) is applied to the intensity 
of each of the pixels of the image, information pertaining to the distance 
between the respective points of the object are two dimensionally obtained, 
whereby three dimensional information pertaining to — the — object can be 
detected. 

[0017] 

As shown in FIGS. 3 A and 3B, even when the intensity I of the light 
source diminishes, as specified by 1 = 10 St, the distance "d" can be obtained in 
the same manner as mentioned previously. 

[0018] 

Further, let Ir = I0; then 
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As in the case of the pr e vious example, tho optical image form ed-by 
collection of light reflected from th e object. So long as Equation (8) or (9) is 
applied to each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two dimensionally 
obtained, whereby three dimensional information pertaining to the object can 
be obtained. 

[0019] 

Referring to FIG. — 4^ — a three dimensional information — detecting 
method according to a second embodiment of the present invention will now 
be describ e d. As shown in FIG. 1, tho object is illuminated while the intensity 
of illumination light is modulated by employment of a triangular wav e form. 
An optical image of reflected light is acquired twice; in other words, an optical 
image of reflected light whoso intensity is 1 1 is acquired at time t = t0 for only a 
short period of tim e t («T) with an image pick up gain g = g0(>0), and an 
optical image of reflected light whoso intensity is I — is acquired at time 
t=to i T/2 for only a short period of time t («T) with th e image pick up gain 
g = g0(>0). From Equations (1) and (6), w e have 

Let the wavel e ngth of illumination light modulat e d by a triangular 
waveform bo defin e d as =T; then from S = I0/(T/2), we have 
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Further, if tO is set to a given valu e , distance "d" can bo express e d as 
a relative distance with reference to a reference point dref. Equation (13) 
represents a relative distance with reference to drof = 0 when tO = TA1. 

[0020] 

, As in th e case of the first embodiment, the optical image is form e d by 
collection of light refl e cted from the object. So long as any one of Equations 
(11), (12), and (13) is applied to each of the pixels of the image, information 
pertaining to the distance betwe e n the r e spective points of the object ar e two 
dimonsionally obtained, whereby three dimensional information pertaining to 
the object can be obtained. 

[0021] 

According to a method which is complementary to the thr e e 
dimensional information det e cting methods described in connection with the 
first and second e mbodiments, three dimensional information pertaining to an 
object can bo detected by capturing th e image of the object with an image 
pick up — gain, — which — linearly — increases — e* — decreases, — through — use — ef 
illumination light modulated in the form of a pulse for a short period of time. 

[0022] 
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A throe dimensional information detecting method according to a 
third embodiment of the present invention will be described by ref e rence to 
FIGS. 5 and 6. As shown in FIG. 5A, illumination light is modulated such that 
an image pick up gain "g" is linearly increased (i.e., g = Ut). Further, an object 
is exposed to light which illuminates like a puls e with intensity 1 = 10 for only a 
short period of time t («T). Here, U designates tho rate of increase in image 
pick up sensitivity ( = 2gO/T). The image pick up gain g I obtained when the 
light refl e cted from the object that is spaced only distance "d" from tho three 
dimensional information detecting device has returned to the image pick up 
device b e comes g -i = U(tO + 2d/v). The intensity IrOg I of an imag e resulting 
from the reflected light being captured is expressed by Equation (14). 

[0023] 

Further, in order to eliminate the dependency of term , the object is 
illuminated for a short period of time t from time T' while the imago pick up 
gain "g" is uniformly maintained at g = gr. At this time, luminous intensity 
IrOgr is expressed by Equation (15). 

[0024] 

Tho following equation is derived from Equations (14) and (15). 
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From Equation (16), w e have 

Further, suppose gr=gO; the following expression is derived from 
U = gO/(T/2). 

Tho distance "d" is derived from Equation (17) or (18). As in the case 
of the first and second embodiments, an optical image formed by collection of 
the light reflected from the object is captured. So long as Equation (17) or (18) 
is applied to the intensity of each of the pixels of the image, information 
pertaining to the distance between the respective points of the object are two 
dimensionally obtained, whereby three dimensional information pertaining to 
the object can be detected. 

[0025] 

As shown in FIG. 25, even when the imag e pick up gain "g" 
decreases (g = g0 Ut), the distance "d" can be obtained in the same manner as 
that employed previously. 

[0026] 
^20) 
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As mentioned previously, an optical image formed by collection of 
the light r e flected from the object is captured. So long as Equation (21) or (22) 
is applied to the intensity of each of the pixels of the imag e , information 
pertaining to the distanc e between the respective points of the object are two 
dimensionally obtained, whereby thr e e dimensional information pertaining to 
the object can be detected. 

[0027] 

A throe dimensional information detecting method according to a 
fourth embodiment of the present invention will now be d e scribed by 
reference to FIGS. 7 A and 7B. As shown in FIG. 7 A, the imago pick up gain 
"g" is modulated through use of a triangular waveform, and an object is 
illuminated twice; in other words, an optical imag e is illuminated at time t = t0 
through use of light which illuminates in a pulsating manner with intensity 
1 = 10 for only a period of time t («T), and an object is illuminated at time 
t = tO + T/2 through use of light which illuminates in a pulsating manner with 
intensity 1 = 10 for only a period of timo t («T). From Equations (15) and (19), 
we hav e 

^34) 
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Suppose the — wavelength — of th e — triangular — waveform — usod for 
modulating the image pick up sensitivity is defined as = T for convenience's 
sake, the following expression is d e rived from U = gO/(T/2). 

As in the case of the second embodiment, if tO is sot to a given value, 
the distance "d" can be e xpressed as a relative distance with reference to the 
referenc e point dref. Equation (26) represents the relative distance with 
reference to dref = 0 when tO = TA1. 

As mentioned previously, an optical image formed by collection of 
the light reflected from the object is captured. So long as Equation (24), (25), 
or (26) is applied to each of the pixels of the image, information pertaining to 
the distance between the three dimensional information detecting device and 
the respective points of the object are two dimensionally obtained, whereby 
three dimensional information pertaining to the object can be detected. 

[0029] 

A method of increasing the image pick up sensitivity in each of the 
previous embodiments will now be described. In the previously embodiments, 
acquisition of an imag e having intensity I i gO and an image having intensity 
IrcfgO for the purpose of determining R \ , acquisition of an image having 
intensity I g and an image having intensity IrefgO for the purpose of obtaining 
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R , or acquisition of an image having intensity i J- gO and an image having 
intensity I gO for the purpose of determining R is performed a plurality of 
times within th e period of time corresponding to one frame of an image signal. 
As a result, th e signal to noise ratio (S/N) is improved by the storage effect of 
the image pick up element used for acquiring an imago, whoroby the image 
pick up sensitivity is improved. 

[0030] 

The configuration of the three dimensional information detecting 
devic e shown in FIG. 1 will now be described in detail by reference to the 
drawings. 

[0031] 

FIG. 8 shows a proj e ction section 10a which is another embodiment 
of the projection section 10 shown in FIG. 1. The projection section 10a 
comprises a light emitting element 31 whose light can be directly modulated 
by an illumination modulation signal SI, and an illumination optical system 30 
which is disposed opposite the light exit surface of the light emitting elem e nt 
31, which shapes the light emitted from the light omitting element 31, and 
which directs the light toward the object. For example, a semiconductor laser 
diod e or a s e miconductor light emitting diode can be employed as the light 
emitting element 31. When such a light emitting element is activated directly 
by the illumination light modulation signal SI which is an e lectric signal, the 
element can emanate light whose intensity is changed at high speed. The thus 
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produc e d light is shaped by means of an illumination optical system 30 so as 
te — illuminat e — an — object, — whoreby — illumination — light — S6 — is — produc e d. 
Accordingly, illumination light whose intensity is arbitrarily changed at high 
speed, such as increment light, decr e ment light, or pulse like light, can be 
r e alized by means of the illumination light modulation signal SI. As 
mentioned above, the projection section having the configuration shown in 
FIG. 8 can be used as m e ans for controlling the intensity of illumination light 
under the three dimensional information detecting method of th e present 
invention. 

[0032] 

FIG. 9 shows a projection section — 10b which is still another 
embodiment of the projection section 10 shown in FIG. 1. The projection 
section 10b comprises a light omitting element 33 which outputs given light; 
an external modulator 32 which is disposed opposite the light exit surface of 
the light emitting element 33 and indirectly modulates the light emanated from 
the light emitting element 33 in accordance with tho illumination light 
modulation signal SI; and an illumination optical system 30 which shapes the 
light output from the external modulator 32 and is directed toward the object. 
An — electro optical — effect — light — modulator or — an — electro acoustic — effect 
modulator can bo used as the external modulator 32. Light whose intensity is 
modulat e d arbitrarily and at high spe e d can be produced by indirect 
modulation of the given light 31 output from th e light emitting element 3 4 , 
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through uso of the external modulator 32. The thus produced light is shaped 
by the illumination optical system 30 so as to illuminate an object, whereby 
the illumination light S6 is produced. Like tho projection section shown in 
FIG. 8, the projection section whose configuration is show in FIG. 9 can be 
used as means for controlling the intensity of illumination light under the 
three dimensional information detecting method of tho present invention. 

FIG. — 10 shows an image pick up section — 11 which is another 
embodiment of the image pick up section 11 shown in FIG. 1. The image 
pick up section 1 1 comprises a lens 4 which receives light reflected from an 
object and produces an optical image, an image pick up element 6 which is 
disposed behind the lens 4 and picks up the optical image output from the lens 
4, and an image split circuit 22 which outputs a video signal pertaining to a 
plurality of screens included in the electric signal output from the image pick 
up element 6 while the video signal is divided into resp e ctive screens. Further, 
an image intensifier with gating operation 5 capable of controlling the image 
pick up gain in accordance with the image pick up gain modulation signal S2, 
which is an electric signal, is attached to the front surface of the image pick up 
element 6 via an optical image transfer optical system 20. A fib e r plate or lens 
can be used as the optical image transfer optical system 20. Light S7 reflected 
from an obj e ct is formed on a photo electric screen of the image intensifier 
with gating operation 5 by means of tho lens 4 . An optical image amplified by 
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the image intensifier with gating operation 5 is transferred by the optical 
imago transfer optical system 20 and input to the photo e lectric screen of the 
image pick up element 6. 

[0031] 

The light amplification gain of the image intensifier with gating 
operation 5 can b e controlled at high speed by means of a voltago to be 
applied to a gate 21 of the image intensifier with gating operation 5. In the 
image pick up section 11, the image pick up gain can bo changed at high 
speed by application of the image pick up gain modulation signal S2 to the 
gate 21. Accordingly, an image pick up gain which is changed arbitrarily at 
high speed, such as a puls e like image pick up gain to be used for releasing a 
shutter for only a short period of time or an increment or decrement image 
pick up gain, can be achieved. 

[0035] 

In a case where the image pick up section 11 is used in each of the 
previous embodiments, the image pick up s e ction 1 1 must acquire an imago 
twice for calculating R I , R , or R and output a video signal pertaining to two 
screens per frame while the signal is split. To this ond, in tho image pick up 
section 11, the image pick up element 6 is activated twice as fast as it is 
activated in normal times, to thereby acquir e a video signal pertaining to two 
images. The video signal is output from the image split circuit 22 while being 
divided into a video signal S41 and a video signal S 4 2. Alternatively, so long 



49 



as th e re is employed an imago pick up element capabl e of acquiring an imag e 
for each pixel and at every image pick up operation whil e effecting switching 
betwe e n the video signal S41 and th e video signal S12, the video signals 4 1 
and 4 2 can be output while they are split. 

[0036] 

As — mentioned — above, — the — image — pick up — section — J4 — whoso 
configuration is shown in FIG, 10 can bo used as means for controlling the 
image pick up gain under the three dimensional information detecting method 
of the present invention. Further, the image pick up section 1 1 can also be 
used as means for outputting two vid e o signals resulting from twice 
acquisition of an image while being split. 

[0037] 

FIG. 1 1 shows a signal processing section 7 which is an embodiment 
of th e signal processing section 7 shown in FIG. 1. In this signal processing 
section 7, an internal signal is driven at a rate which is tho same as the number 
of pixels of the video signal and i s subj e cted to pipe line processing in 
individual circuits. After a synchronous signal has been eliminated from the 
video signals S^ll in a synchronous signal separation circuit 41, the video 
signal S43 is stored in an image pick up level storage circuit 1, and the video 
signal is stored in an image pick up level storage circuit 2. A signal S15 
output from the imago pick up lovol storage circuit 1 and a signal S 4 6 output 
from th e image pick up level storage circuit 2 are input to a computation 
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circuit 41, wher e Ri, R , or R and th e distance "d" are computed. A signal 
S 4 7 output from the computation circuit ^ is a time series signal resulting 
from two dimensional — scanning of the distance between — the respective 
sections of the obj e ct. Tim e axis fluctuations in the signal SI 7 are corrected 
by a storage circuit 45, and a synchronous signal is added to the thus corrected 
signal b a synchronous signal addition circuit 4 6. The signal is output as a 
three dimensional signal S5 whose video level corresponds to the value of 
information pertaining to the distance "d" between the respective points of the 
object. — As — mentioned — above, — the — signal — processing — section — 7 — whose 
configuration is shown in FIG. 1 1 can be used as a means for computing three 
dimensional information pertaining to an object in real time under the three 
dimensional information detecting method of tho present invention. 

[0038] 

[Advantageous Result of the Invention] 

As has been described in detail, the present invention enables two 
dim e nsional determination of the distance betwe e n individual points of an 
object at a speed at which the three dimensional information can bo followed 
real time within a period of time corresponding to the frame of a video signal, 
as well as detection of three dimensional information, by utilization of 
information pertaining to th e intensity of an imag e of the object acquir e d 
under condition that either the intensity of illumination light or an image pick 
up gain is changed with time. Consequently, the method and apparatus of the 
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pr e sent invention can bo suitably used for acquiring a three dimensional 
motion picture of an object. 

[BRIEF DESCRIPTION OF THE DRAWINGS] 

FIG. 1 is a schematic diagram showing the configuration of a three 
dimensional information detecting device according to a first embodiment of 
the present invention; 

FIG. 2 is an illustration for describing a method of detecting throe 
dimensional information by utilization of illumination light which linearly 
increases and has given intensity and a pulse like image pick up gain in 
combination, wherein FIG. 2A shows a time varying waveform determined by 
the intensity I of illumination light and an image pick up gain "g," and FIG. 
2B shows a tim e varying waveform determined by the image pick up gain "g" 
and the intensity IR of light refl e cted from an object spaced away from a 
projection section by only distance "d"; 

FIG. 3 is an illustration for describing a method of detecting three 
dimensional information by utilization of illumination light which linearly 
d e creases and has given intensity and a pulse like image pick up gain in 
combination, wherein FIG. 3A shows a time varying waveform determined by 
the intensity I of illumination light and an imago pick up gain "g," and FIG. 
3B shows a time varying waveform determined by the image pick up gain "g" 
and the intensity IR of light reflected from an object spaced away from a 
projection section by only distance "d"; 
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FIG. A is an illustration for describing a method of detecting three 
dimensional information by utilization of illumination light which linearly 
increases and decreases and has given intensity and a puls e like image pick up 
gain in combination, whoroin FIG, 4 A shows a time varying waveform 
dotorminod by the intensity I of illumination light and an image pick up gain 
"g," and FIG. 1B shows a tim e varying waveform determined by tho image 
pick up gain "g" and the intensity IR of light reflected from an object spaced 
away from a projection s e ction by only distance "d"; 

FIG. 5 is an illustration for describing a method of detecting thr e e 
dimensional information by utilization of a given imago pick up gain which 
linearly increases and illumination light having pulse like intensity in 
combination, wherein FIG. 5A shows a time varying waveform dotorminod by 
the intensity I of illumination light and an image pick up gain "g," and FIG. 
5B shows a time varying wav e form determined by the image pick up gain "g" 
and th e intensity IR of light reflected from an object spaced away from a 
projection section by only distance "d"; 

FIG. 6 is an illustration for describing a method of detecting thr ee 
dimensional information by utilization of a given image pick up gain which 
linearly docroasos and illumination light having a pulse like intensity in 
combination, wheroin FIG. 6A shows a time varying waveform det e rmined by 
th e intensity I of illumination light and an imag e pick up gain "g," and FIG. 
6B shows a time varying waveform determined by the image pick up gain "g" 
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and the intensity IR of light reflected from an object spaced away from a 
projection section by only distanc e "d"; 

FIG. 7 is an illustration for describing a method of detecting three 
dimensional information by utilization of a given image pick up gain which 
linearly increases and decreases and illumination light having puls e like 
intensity in combination, wherein FIG. 7A shows a time varying waveform 
determined by the intensity I of illumination light and an image pick up gain 
"g," and FIG. 7B shows a time varying waveform determined by the image 
pick up gain "g" and the intensity IR of light reflected from an object spaced 
away from a projection section by only distance "d"; 

FIG. 8 is a schematic diagram showing the configuration of a 
projection section equipped with a light emitting element whose light is 
directly modulated; 

FIG. 9 is a schematic diagram showing the configuration of a 
projection section equipped with a light emitting element whose light is 
indirectly modulated; 

FIG. 10 is an illustration showing the configuration of an image pick 
up s e ction employing an image intensifior (II) with gating operation; 

FIG. 11 is an illustration showing the configuration of a signal 
processing s e ction; 
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FIG. — 12 is an illustration showing a conventional — method of 
measuring the distance botwoen an object and a three dimensional information 
detecting device on the basis of a lag tim e or modulated phase of a reflected 
laser beam; 

FIG. — 13 — is — an illustration — showing a conventional — method of 
activating a laser beam so as to effect two dimensional scanning; and 

FIG. 11 is an illustration showing the configuration of a conventional 
imaging laser radar apparatus, 

[Description of the Referenc e Num e rals] 

1 ... signal generation section, 4 ... lens, 5 ... image intensificr with 
gating operation, 6 ... image pick up clement, 7 . . . signal processing section, 
10 ... projection section, 11 ... image pick up section, 20 ... optical image 
transfer optical system, 21 — ... gate, 22 ... image split circuit, 30 ... 
illumination optical system, 31 ... light emitting element, 32 ... ext e rnal 
modulator 

[DOCUMENT NAME] ABSTRACT OF THE DISCLOSURE 
[Abridgment] 

[Object] It is an object of the present invention to provide a method 
and apparatus which can be appli e d for acquiring a three dimensional imago 
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of an object and detect three dimensional information pertaining to the object 
real time within a period of time corr e sponding to the frame of a video signal, 

[Moans for Achieving the Object] ) 



56 



rABSTRACT OF THE DISCLOSURE! 



An image of an object illuminated by illumination light having given 
intensity is formed as an optical image. The distance between respective 
points of the object is determined on the basis of a video which is obtained by 
acquiring the optical image with a given image pick-up gain. Here, either the 
intensity of the illumination light or the image pick-up gain is changed with 
time. The distribution of intensity of the image acquired by utilization of such 
intensity or image pick-up gain reflects a time lag between the time at which 
the illumination light is emitted from a light source and the time at which the 
light reflected from individual points of the object reaches an image pick-up 
device. The distribution of intensity includes information pertaining to the 
distance between the light source and the respective points of the object. 
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( Th e prooont invention enables detection of thr e e dimensional informati en-at 
a spe e d at which the thre e dimensional information can be followed real time 
within a period of tim e corresponding to the frame of the video signal. 

[Charact e ristic Drawing] FIG. 1 

[DOCUMENT NAME] DRAWINGS 

[FIG. 1] 

OBJECT 

I SIGNAL GENERATION SECTION 
7 SIGNAL PROCESSING SECTION 
10 PROJECTION SECTION 

I I IMAGE PICK UP SECTION 

51 ILLUMINATION LIGHT MODULATION SIGNAL 

52 IMAGE PICK UP GAIN MODULATION SIGNAL 

53 CONTROL SIGNAL 

55 THREE DIMENSIONAL INFORMATION SIGNAL 

56 ILLUMINATION LIGHT 

57 REFLECTED LIGHT 
S4 1, S12 VIDEO SIGNAL 
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[FIG. 8] 

LIGHT EMITTING ELEMENT 

SI ILLUMINATION LIGHT MODULATION SIGNAL 

S6 ILLUMINATION LIGHT 

10A PROJECTION SECTION 

30 ILLUMINATION OPTICAL SYSTEM 

[FIG. 9] 

10B PROJECTION SECTION 

SI ILLUMINATION LIGHT MODULATION SIGNAL 
S3 LIGHT EMITTING ELEMENT 
S6 ILLUMINATION LIGHT 

30 ILLUMINATION OPTICAL SYSTEM 
33 LIGHT EMITTING ELEMENT 

31 FLXED LIGHT 

[FIG. 10] 
1 LENS 

5 IMAGE INTENSIFIER WITH GATING OPERATION 
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6 IMAGE PICK UP ELEMENT 
1 1 IMAGE PICK UP SECTION 

20 OPTICAL IMAGE TRANSFER OPTICAL SYSTEM 

21 GATE 

22 IMAGE SPLIT CIRCUIT 

52 IMAGE PICK UP GAIN MODULATION SIGNAL 

53 CONTROL SIGNAL 

S7 LIGHT REFLECTED FROM OBJECT 

511 VIDEO SIGNAL 

5 12 VIDEO SIGNAL 

[FIG. 11] 

7 SIGNAL PROCESSING SECTION 

1 1 SYNCHRONOUS SEPARATION CIRCUIT 

12 IMAGE PICK UP LEVEL STORAGE CIRCUIT 1 

13 IMAGE PICK UP LEVEL STORAGE CIRCUIT 2 
11 COMPUTATION CIRCUIT 

15 STORAGE CIRCUIT 

16 SYNCHRONOUS SIGNAL ADDITION CIRCUIT 
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S3 CONTROL SIGNAL 

S5 THREE DIMENSIONAL INFORMATION SIGNAL 

S11 AND SI 2 VIDEO SIGNAL 

S17 SYNCHRONOUS PHASE CONTROL CIRCUIT 

[FIG. 12] 

PULSE LASER 

HALF MIRROR 

REFLECTED PULSE 

OBJECT 

STOP 

START 

TIME COUNT CIRCUIT 

TIME DURING WHICH LASER BEAM TRAVELS 

START 

STOP 

TIME DURING WHICH THE LASER BEAM TRAVELS BACK AND 
FORTH, DISTANCE 

LASER (CONTINUOUS WAVE) 
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AMPLITUDE MODULATION 
REFLECTED LIGHT 
OBJECT 

OSCILLATION CIRCUIT 

PHASE DIFFERENCE DETECTION CIRCUIT 

TIME DURING WHICH LASER BEAM TRAVELS 

TRANSMITTED LASER BEAM 

RECEIVED LASER BEAM 

PHASE DIFFERENCE (AFTER THE LASER BEAM HAS TRAVELED 
BACK AND FORTH), DISTANCE 

[FIG. 13] 

PULSE LASER BEAM 
COLLIMATOR 
BEAM SCANNER 
TARGET 
COLLIMATOR 
PHOTO MULTIPLEXER 

CONSTANT RATIO THRESHOLD VALUE CIRCUIT 
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STOP 

TIME TO PULSE HEIGHT CONVERTER 
START 

AVERAGING CIRCUIT 

AD CONVERTER INTERFACE 

BEAM SCANNER INTERFACE 

COMPUTER 

TARGET 

9 MHz OSCILLATOR 
15 mW HoNo LASER 
OPTICAL MODULATOR 
BEAM SPLITTER 
SCANNER MOTOR 
PHOTO MULTIPLEXER 
0 MHz FILTER 
NETWORK ANALYZER 
AMPLITUDE 
PHASE 
computer 
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[FIG. 11] 

9 TV CAMERA 

1 1 SINUSOIDAL WAVEFORM OSCILLATOR 

12 A PHASE CONTROL 

12B PHASE CONTROL 

13 A AMPLIFICATION 

13B AMPLIFICATION 

11 DC POWER 

15 SUPERIMPOSING RF SIGNAL ONTO VIDEO SIGNAL 

16 WAVEFORM SHAPING 

17 FREQUENCY DIVISION AND DELAY 

18 SETTING OF GATE WIDTH 

[DESCRIPTION OF THE REFERENCE NUMERALS] 

1 OBJECT 

2 LASER BEAM 

3 IMAGE INTENSIFIER TUBE 

31 PHOTO ELECTRIC SURFACE 

32 FIBER OPTICAL PLATE 
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33 LIGHT RECEIVING SURFACE 

11 SINUSOIDAL WAVE GENERATION CIRCUIT 

12 PHASE CONTROL CIRCUIT 

13 AMPLIFIER 

11 DC POWER CIRCUIT 

15 RF SIGNAL SUPER-IMPOSING CIRCUIT 

16 WAVEFORM SHAPING CIRCUIT 

17 FREQUENCY DIVISION AND DELAY CIRCUIT 

18 GATE WIDTH SETTING CIRCUIT 

19 MCP GATE DRIVE CIRCUIT} 
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